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[57] ABSTRACT 

An efficient connection technique maximizes the rate at 
which data are transferred among source and destination 
network cards of a distributed network switch. Such maxi- 
mum data rates are achieved by interconnecting the network 
cards through a mesh backplane comprising a novel arrange- 
ment of direct and indirect paths between the cards and 
thereafter transferring the data over those paths. In accor- 
dance with the invention, the indirect data path utilizes an 
additional network card of the switch as a 2-hop relay to 
provide transfer rate efficiency between the source and 
destination cards. 

18 Claims, 6 Drawing Sheets 



500 



123456789 10 11 



1 




8 


6 


4 


4 


3 


3 


2 


2 


2 1 


• • 1 


2 


8 




6 


4 


4 


3 


3 


2 


2 


2 1 


• • 1 


3 


6 


6 




4 


4 


3 


3 


2 


2 


2 1 


• • 1 


4 


4 


4 


4 




4 


3 


3 


2 


2 


2 1 


• • 1 


5 


4 


4 


4 


4 




3 


3 


2 


2 


2 1 


• • 1 


6 


3 


3 


3 


3 


3 




3 


2 


2 


2 1 


• • 1 


7 


3 


3 


3 


3 


3 


3 




2 


2 


2 1 


• • 1 


8 


2 


2 


2 


2 


2 


2 


2 




2 


2 1 


• • 1 


9 


2 


2 


2 


2 


2 


2 


2 


2 




2 1 


• • 1 


10 


2 


2 


2 


2 


2 


2 


2 


2 


2 




• • 1 


11 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 


• • 1 


• 
























16 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 1 


1 1 



16 



■ i. 



02/18/2002, EAST Version: 1.02.0008 



U.S. Patent May 12, 1998 Sheet 1 of 6 5,751,710 




02/18/2002, EAST Version: 1.02.0008 



U.S. Patent May 12, 1998 Sheet 2 of 6 



5,751,710 



200 



400' 



220 
220 



220 



202 



n 



n 



n 



1 



210 
210 



>210 
"210 



V/////////////////A 



•230 



FIG. 2 



I 



02/18/2002, EAST Version: 1.02.0008 



U.S. Patent 



May 12, 1998 



Sheet 3 of 6 



5,751,710 



TO/FROM 
(BACKPLANE 400) 



300 



310 



INTERFACE 350 
1 



PROCESSING 
ELEMENT 330 



310 



PORT 



310 



PORT 



PORT 



310 



PORT 



/PHYSICAL\ /PHYSICALX /PHYSICALN /PHYSICAL\ 
V MEDIA / V MEDIA / V MEDIA / V MEDIA / 



FIG. 3 



02/18/2002, EAST Version: 1.02.0008 




02/18/2002, EAST Version: 1.02.0008 



U.S. Patent May 12, 1998 Sheet 5 of 6 



5,751,710 



500 



123456789 10 1 



16 



1 




8 


6 


4 


4 


3 


3 


2 


2 


2 


2 


8 




6 


4 


4 


3 


3 


2 


2 


2 


3 


6 


6 




4 


4 


3 


3 


2 


2 


2 


4 


4 


4 


4 




4 


3 


3 


2 


2 


2 


5 


4 


4 


4 


4 




3 


3 


2 


2 


2 


6 


3 


3 


3 


3 


3 




3 


2 


2 


2 


7 


3 


3 


3 


3 


3 


3 




2 


2 


2 


8 


2 


2 


2 


2 


2 


2 


2 




2 


2 


9 


2 


2 


2 


2 


2 


2 


2 


2 




2 


10 


2 


2 


2 


2 


2 


2 


2 


2 


2 




11 


1 


1 


1 


1 


1 


1 


1 


1 


1 


1 



16 



111111111 



FIG. 5 



02/18/2002, EAST Version: 1.02.0008 



U.S. Patent 



May 12, 1998 



Sheet 6 of 6 



5,751 




02/18/2002, EAST Version: 1.02.0008 



5,751,710 

1 2 

TECHNIQUE FOR CONNECTING CARDS OF loss of a single cross-point path in the switch card destroys 

A DISTRIBUTED NETWORK SWITCH the connection between the two corresponding cards, a 

situation that effectively renders the network switch inop- 
FIELD OF THE INVENTION erable. A solution to this latter problem may be to provide 

n . . „ , . , ,,5 two. redundant switch cards per enclosure, although this is 

This invention relates generally to network switches and, M iye ^ c ^tcd option primarily because of 

more particularly, to an arrangement for efficiently intercon- redundancy and synchronization requirements, 
necting cards of a network switch. ... . . ... 

An alternative to the cross-bar arrangement is the cube 

BACKGROUND OF THE INVENTION interconnect, e.g.. the hybercube network. The hybercube 

10 network is typically employed for interconnecting many (N) 

A switched communication network comprises a collec- processing elements in an n-dimensional cube arrangement, 
tion of interconnected nodes in which data are routed where N=2 n . Here, each processing element is connected to 

through the network between communicating nodes. Hie n other elements with the longest communication path from 
nodes may be computers configured as end nodes and any two elements being n connections. For example, a 

intermediate nodes, the latter connecting only to the end 15 4-dimensional hypercube contains 16 processing elements 

nodes or other intermediate nodes of the network. These where each element is connected to four other elements, 

intermediate nodes function primarily to provide a switching According to this architecture, data transfers originating 

facility that transfers data among the other nodes and, thus, from source element must expect to traverse 4 "hops" to 

are generally referred to as network switches. As used reach a destination: one hop to get into the correct set of 8 

herein, the term "network switch" includes bridges, routers 20 elements> another hop to get into the proper set of 4 

and other similar intermediate network nodes. elements, another to reach the desired set of 2 elements and 

The network switch typically comprises an enclosure then a last hop to the proper destination. Doubling the 

having a plurality of connector slots for receiving network number of processing elements results in a unit increase in 

cards, such as input/output line cards. The network cards are, the communication path length. Furthermore, the cube archi- 

in turn, interconnected by a backplane of wires that is often 25 tecture requires that all processing elements be present to 

controlled by a switching matrix to transfer data among the enable such multiple-hop transitions, 

cards. TYpically. the matrix comprises circuitry contained on The present invention is directed to reducing the number 

a switch card that is centrally-located (with respect to the of hops to efficiently transfer data between a source 

backplane) for receiving and transmitting data among source element and a destination element in a communication 

and destination cards internal to the switch. 30 ncrW ork. More specifically, the invention is directed to 

The centralized switching matrix may be implemented as eliniinating the conventional switching function of a net- 

a bus. a cross-bar or other type of interconnection of wires. work switch by regulating the flow of data over a configu- 

such as a cube, A bus is a multipoint data path that inter- ration of interconnected network cards in a manner that 

connects more than two cards. Because multiple cards share 35 reduces the number of hops needed to optimize data transfer 

a single data path, only one may transmit at a time; this efficiency through the switch, 
raises the problem of determining which card may transmit 

at any point in time. A centrally-located switch card matrix SUMMARY OF THE INVENTION 

may also function as an arbiter to resolve such contention. xh e invention comprises an efficient connection tech- 

Although an inexpensive solution, this approach provides ^ ^ uc f OI maximizing the rate at which data are transferred 

relatively low performance because it cannot handle signifi- among source and destination network elements of a dis- 

cant parallel activity. tributed network switch. Such maximum data rates are 

In contrast, a cross-bar switching matrix provides a point- achieved by interconnecting the network elements through a 
to-point connection between a source card transmitting data mesh backplane comprising a novel arrangement of direct 
and the switch card, and a further point-to-point connection 45 and indirect paths between the elements and thereafter, 
between the switch card and the destination card. Each transferring the data over those paths. In accordance with the 
connection thus requires the establishment of a physical. invention, the indirect data path utilizes an additional net- 
cross-point path through the switch card that is dedicated work element of the switch as a 2-hop relay to provide 
solely to the transfer of data between the source and desti- transfer rate efficiency between the source and destination 
nation cards. Here, the number of connections increases with $q elements. Significantly, the arrangement of direct and indi- 
the square of the number of cards in the switch; these rect paths obviates use of a convention switching matrix, 
connections may be large, even where a physical path ^ mc illustrative embodiment the backpane may be a full 
consists of a single wire. or partial mesh arrangement of dkect/indirect data paths 

However, a single wire connection between cards may be administered by circuitry distributed among each of the 

insufficient to provide the bandwidth required for relatively 55 network elements, e.g.. cards, of the switch. Data path 

high-data rate applications. In this case, each point-to-point administration is preferably the result of a transfer rate 

connection typically comprises many wires which, for a process performed by the circuitry in connection with a 

conventional network switch, results in a voluminous num- conventional routing algorithm. That is. the distributed 

ber of wires in the enclosure. A very large connector circuitry initially cooperate to establish a direct path for 

assembly would be required to accomodate these wires at go transferring data among selected source and destination 

the switch card. Yet. a typical connector of such size may not cards. If the data . to be transferred exceeds the maximum 

fit in the enclosure, thereby necessitating use of an amount allowable over that direct path, the circuitry further 

expensive, customized connector. In the alternative, the selects an additional network card as a relay for transferring 

connector function must be apportioned onto two or three the excess data over an indirect path between the source and 

cards which consumes valuable card space in the enclosure. 53 destination. 

A more significant problem with the cross-bar switch may Advantageously, the inventive connection technique 

concern its susceptibility as a single point of failure. That is. eliminates the conventional "switching" function of a net- 
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work switch by regulating the flow of data over a parallel 
configuration of interconnected network cards selected to 
optimize data transfer efficiency through the switch. The 
novel arrangement of direct and indirect data paths further 
accomodates both failed and missing network cards in the 
switch to generally simulate a point-to-point, centralized 
switch in a cost-effective manner. Moreover, the geometry of 
the connection technique defines an asymmetric mesh 
arrangement characterized by a maximum 2-hop relay tra- 
versal between source and destination cards that differs from 
the conventional cube architecture. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The above and further advantages of the invention may be 
better understood by referring to the following description in 
conjunction with the accompanying drawings in which like 
reference numbers indicate identical or functionally similar 
elements: 

FIG. 1 is a schematic block diagram of a communication 
network comprising a collection of interconnected nodes 
including a network switch; 

FIG. 2 is a schematic block diagram of the network switch 
having a plurality of network elements in which the inven- 
tion may be advantageously used; 

FIG. 3 is a schematic diagram of a network element of 
FIG. 2. such as an input-output line card; 

FIG. 4 is a schematic diagram illustrating an embodiment 
of a novel connection technique comprising an arrangement 
of direct and indirect data IS paths between the network 
elements in accordance with the invention; 

FIG. 5 is a table depicting the number of connections 
needed between cards of the network switch in order to 
ensure full bandwidth access in accordance with the novel 
connection technique of the present invention; 

FIG. 6 is a highly schematized diagram of a full mesh 
arrangement for interconnecting cards of the network switch 
in accordance with the novel connection technique of the 
present invention; and 

FIG. 7 is a highly schematized diagram of a partial mesh 
arrangement for interconnecting network cards in accor- 
dance with the novel connection technique of the present 
invention. 

DETAILED DESCRIPTION OF ILLUSTRATIVE 
EMBODIMENT 

FIG. 1 is a schematic block diagram of a communication 
network 100 of interconnected nodes in which the novel 
connection technique of this invention may be advanta- 
geously used. The nodes are typically general-purpose com- 
puters comprising a source node N, end nodes E and a 
destination node D. Each node is coupled to a respective 
network switch "S" 200. which is preferably a specialized 
computer that provides a facility for transferring data 
between the source and destination nodes. 

Each node typically comprises a processor element 102, 
a memory element 104 and at least one input/output (I/O) 
element 106 interconnected by a bus 110. The memory 
element 104 may comprise storage locations composed of 
random access memory (RAM) devices, which are addres- 
sable by the processor element 102 and I/O element 106. An 
operating system, portions of which are typically resident in 
memory and executed by the processor, functionally orga- 
nizes the node by. inter alia, invoking network operations in 
support of software processes executing on the node. 

FIG. 2 is a schematic block diagram of the network switch 
200 comprising an enclosure 202 having a plurality of slots 
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210 terminated by connectors 220. each of which is config- 
ured to receive a network card. The network cards consist of 
a plurality of line cards 300 and a utility card 230. the latter 
providing maintenance functions and containing timing and 
5 storage capabilities . When inserted into respective connector 
slots, the cards communicate within the switch 200 by 
transmitting and receiving data over a backplane 400 of 
wires interconnecting the connectors. 

Illustratively, the switch is preferably embodied as a 
i° 16-slot enclosure, although other embodiments may include 
8-. 24- or 32-slot enclosures. A feature of the present 
invention is the interchangeability of the cards inserted into 
the backplane 400; that is. the same cards may be reused in 
any of the different slotted enclosures contemplated by the 
15 invention. In an alternate embodiment, the switch may be 
configured as two enclosures connected in tandem to 
increase the capacity of the switch. Each of the embodiments 
may be configured to operate in accordance with the novel 
connection technique described herein. 
20 FIG. 3 is a schematic diagram of a line card 300 that 
contains a plurality of ports 310 functioning as edge or 
trunk-type connectors for attaching to physical communica- 
tion media (PHYSICAL MEDIA), such as Ethernet. Fiber 
Distributed Data Interface. Synchronous Optical Network 
25 Asynchronous Transfer Mode (ATM) and High Level Data- 
Link Control/Synchronous Data-Link Control format media. 
Various data processing communication functions, such as 
packet-type detection, are performed on this card in con- 
nection with a processing element 330. Alternatively, the 
30 line card may be configured to transfer data in accordance 
with ATM applications. For these applications, information 
is transferred in the form of ATM cells, each of which 
contains data and address information. 

In the illustrative embodiment, there are preferably four 
35 (4) 625 megabits per second (Mb/s) input/output ports per 
line card and the inventive distributed switch arrangement 
preferably supports sixteen (16) I/O line cards. Accordingly, 
each card may provide 2.5 gigabits per second (Gb/s) of 
input/output traffic and the switch may transfer approxi- 
40 mately forty (40) Gb/s of data traffic among its ports. To this 
end, each line card also contains a connection interface 
(INTERFACE) circuit 350 configured to format data and 
execute routing decisions for transferring that data over the 
backplane 400 of the switch 200 to other network cards. In 
45 particular, the connection interface 350 contains the circuitry 
needed to receive data from the backplane and pass it to the 
processing element 330, and to receive data from the pro- 
cessing element 330 and pass it over a direct or indirect path 
of the backplane 400. as described further herein. 

Referring also to FIG. 2. it was noted that a switching 
matrix is typically employed to control the transfer of data 
over the backplane 400 and among the cards 300. Typically, 
the matrix comprises circuitry contained on a centrally - 
55 located switch card for receiving and transmitting data 
among source and destination cards within the switch. An 
example of such a switching matrix is a cross-bar switch that 
establishes a point-to-point wire connection between the 
source and destination cards over the backplane. 
60 As further noted, the switch 200 illustratively accomo- 
dates 16 connector slots 210. If the slots are fully populated 
with cards 300, the cross-bar switching matrix ensures that 
each card has a direct path to every other card using the 
point-to-point wires of the backplane. Ideally. Victh of the 
65 total traffic bandwidth is allocated between pairs of cards. 
This arrangement provides maximum performance for uni- 
form traffic mix through the switch, but results in degraded 
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performance where significant traffic occurs between a spe- Additional wires may be added between cards to ensure 

cific pair of source and destination cards, primarily because that there are sufficient relays in the event one of the inserted 

the switching function of the matrix obviates the use of the cards fails. For example, to guard against a failed inserted 

other point-to-point wires which may otherwise be idle. card, forty (40) wire connections may be employed instead 

It would be desirable to utilize the idle backplane wires in 5 of the thirty-two (32) wire connections of the typical 16- slot 

connection with the transfer of data between the source and switch. Accordingly, the entire mesh supports approximately 

destination card pair. The present invention is directed to 2.5NW/2 wires for each card. In the case where more than 

utilizing these otherwise idle wires and to elirninating the OBC carc j fatf^ ^ additional 0.5x wire is needed for each 

conventional switching function of a network switch by f^ c ^ car & 

regulating me flow of teta o^ 10 Qf trflffic tQ ^ nctWQrk ^ M 

nected network cards selected to optimize data transfer m . . ^ fraction of ^ 

efficiency through the switch. Such an inventive arrange- ^ KCtiwed by ^mpuipm. However, a 

"LZy, L invention comprises an efficient connec- ***** ™* ™«* 

^c^u.ca^jr, m t r traffic to the same card for transmission onto the network, 

uon technique for maximizing the rate at which data are , . , j j-*- ^ 1 ™~.,„t 

r j ^ ;L,-„~#- „ .„ rt r „ 15 resulting in an overload condition. For example, the amount 

transferred among source and destination cards or a distnb- \. ^ ^ . _ r l\ . . . . 
uted network switch. Maximum data rates are achieved by of traffic accomodated by each port of a card is preferably 
interconnecting the network cards through a mesh backplane limited to 625 Mb/s. However, several cards may have data 
400 comprising a novel arrangement of direct and indirect destined to the same output port of a card: in this case, there 
paths for transferring data between the cards. As can be seen may be at least 1200 Mb/s traffic on that latter port Since 
in FIG. 4. a source card 402 is connected to a destination 20 only 625 Mb/s data traffic can be delivered by the port, some 
card 408 over a direct data path 410; these cards are further traffic must ordinarily be discarded. To avoid this situation, 
connected by way of indirect data paths 420a, b (hereinafter the novel connection technique provides a mesh that sup- 
designated 420) and 430^6 (hereinafter designated 450). ports 3NW/2 wires for each card; this provides sufficient 

Notably, each of these indirect data paths utilize a single. bandwidth to handle a temporary overload condition. It 

additional network card of the switch as a 2-hop relay to 25 should be noted that these numbers of wires are "rules of 

provide transfer rate efficiency between the source and thumb" for a 16-slot enclosure; the numbers may vary for 

destination cards. For example, network card 404 is used as om€ r network switches having different slot capacities, 

a relay within indirect data path 420 and network card 406 FIG. 5 is a table 500 depicting the number of connections 

is used as a relay within indirect data path 430. By utilizing needed betweefl ^ Stated kto me switch in ordcr t0 

a single relay the inventive technique enables the source 30 cnsurc access to me fuU bandwidth of the switch. As can be 

card 402 to obtain fu I bandwidth of the system ^ using ; a ™ conne ctions. e.g. , V. are needed between a first 

portion of the total backpkne wires that is pe^thu *at ^i) and^econd (2) card, while fewer connections are needed 

allotted for each card of the ™^ ffl ^* ™^ the aaMiiionally-inserted cards because traffic can be 

system. In addition, the invenUve t^niqu .eliminates the £ other cards functioning as 2-hop relays in 

need for such a convendonal sw.tcrnng madix 35 * C oUectrvely. these connections provide a novel 

As will be described further hewn ^ ac^ ntur^ of ^ mcsh bac £ lane arrangement 

wire connections needed to achieve full bandwidth perfor- ' t ^ ° 

mance generally increases at a rate of twice the number of According to the invention. «f «ni»edo> {P^ST* » 

cards (2N) in the box. whereas the centralized scheme configured to mamtam a required bandwidth within the 

increases at rate of N 2 . Thus, in a fully-populated. 16-slot «, ! wilch .5 v ' n rf ^° a P™* ™ J^™* 

switch embodiment. 32 wire connections are needed. Thus, rf the switch is fuMy-populate* tg.. all 16 cards are 

der*ndinguponthepariculartypeofwireused.llshouldbe only a single connection between each card * 

nJed thafthe actual number of 20 wires needed will differ sufficient But rf only 8 cards are inserted into the switch 

among different slotted switches; yet. that number is gen- two connections are needed between foe cards and m fte 

erally smaller than the number needed for a centralized 4S case where only 4 cards are inserted, four connecttonsare 

. ' needed to achieve full-bandwidth performance between 
switch. 

For example, if N cards are connected by a plurality of 01056 car<k - . 
wires, each having a bandwidth of 1 W. then the mesh Although the invention reduces the number of wire con- 
supports NW/2wires for each card. If N equals 16. the mesh nections needed for a fast and efficient distributed switch 
will support 8 times the bandwidth of a single wire, whereas so implementation, it does so at the expense of extensive dau 
if N equals 32. the mesh supports 16 times the bandwidth of path administration of routing deasions. Becauseof the fast 
a single wire. In an illustrative embodiment the bandwidth data rates used in the switch. <ach network card 300 contains 
r*rwleisty P icaUy400Mb/s.although800Mb/swiresmay a special interface circuit 350 (FIG. 3) whose functtons 
also be used include rendering forwarding decisions for the data travers- 

The novel arrangement of direct and indirect data paths * i"g the novel connection arrangement .and ££»*"Jut 

also accomodates an embodiment wherein network switch data for transfer over the data paths of the backplane 400 to 

ids are missing. Preferably, the network cards are inserted the network cards. The connect.™ interface enem 350 1 ,s 

into the slots 210 contiguously from either end of the preferably uBplemented as an ar^hca^on specific integrated 

, . .. * Vl \. „ „ fe • trrr, * Tn circuit (ASIC); in accordance with the invention, the ASIC 

enclosure 202. as indicated by the arrowy ^n FIG. 2 .to e ^ b ^ A ^ mbiMMl ^ taAo t 

general, the number of paths needed to maintain a full 60 wuuuuamiam v : 

bandwidth connection between any source and destination ^e network cards. ^ . ^ 

card pair declines as the number of inserted cards increases It will be apparent to those skilled in the art that die 

becauseof the ability to traverse a relay between the pair of interface 350 contains circuitry needed to inmlement the 

cards. More specifically, in the case of missing cards in the logical and arithmetic operations of rendering forwarding 

16-slot switch enclosure, the number of wires roughly 65 decisions and formating data in order to transfer that data 

doubles. Therefore, the entire mesh supports NW wires for over the inventive arrangement of direct and indirect paths. 

each card The exact circuit configuration of interface 350. along with 



02/18/2002, EAST Version: 1.02.0008 



5/751/710 



7 

the exact arithmetic and logical operations performed by that 
circuit, can be varied without departing from the spirit and 
scope of the invention. 

Included among the administrative duties of the interface 
circuitry 350 is the assessment as to whether a network card 
is currently used as a relay. For a fully-loaded 16- slot switch, 
all sixteen network cards may theoretically be used to 
transfer data from a source card to a destination card. i.e.. 
there may be one direct connection between the source and 
destination, and fourteen indirect 2-hop relay connections 
between those cards. 

In general, a source network card has access to 50% of the 
switch* s resources. That is, a first source card may use a 
particular network card as a relay "half-the-time" while a 
second source card may utilize that relay the rest of the time. 
This arrangement is possible because each relay may simul- 
taneously function as two hops: as a first hop for the first 
source card and as a second hop for the second card. A 
source card may realize these resources by either always 
using half of the cards of the switch or partially using all of 
the cards. 

Because the interface circuitry 350 is involved in all 
aspects of data transfer within the switch, they do not 
contain sufficient buffer capacity to store the data transferred 
among the cards. Accordingly, data transfer is "cut-through" 
these distributed switching circuits using a transfer rate 
process preferably performed by the circuitry 350 in con- 
nection with a conventional routing algorithm, According to 
the process, the distributed circuitry 350 initially cooperate 
to establish a direct path 410 (FIG. 4) for transferring data 
among selected source and destination cards. "on-the-fly*\ If 
the data to be transferred exceeds the maximum amount 
allowable over that direct path, the circuitry further selects 
an additional network card as a relay for transferring the 
excess data over an indirect path 420, 430 between the 
source and destination. Preferably, the transfer of data over 
the direct and indirect paths occur simultaneously, although 
various degrees of overlap and non-overlap of such data 
transfers are contemplated by the invention. Similarly, estab- 
lishment of the indirect data path may occur generally 
contemporaneously with the establishment of the direct data 
path. 

To facilitate such on-the-fly transfers, each network card 
is provided with control information relating to the traffic 
patterns among the network cards. That is, each interface 
circuit 350 broadcasts its input traffic over the backplane 400 
to every other circuit and each circuit 350 further executes 
the same routing algorithm to configure its output ports. This 
latter output configuration information is also broadcast to 
all the network cards so that data may be cut-through the 
backplane interconnecting the cards. As a result, the distrib- 
uted switch behaves like a centralized, cross-bar switch 
without the conventional central switching matrix since the 
switching functions are performed by the interface circuits. 

In the illustrative embodiment the backpane may be a full 
or partial mesh arrangement of data paths administered by 
the distributed interface circuitry 350. FIG. 6 is a highly 
schematized diagram generally depicting a full mesh 600 for 
a fully-populated 8-slot switch. It can be seen that the 
relatively small number of cards increases the number of 
data paths so that there is generally a 4-to-l ratio of wires. 
HG. 7, on the other hand, generally depicts a partial mesh 
700 with the missing cards denoted by unconnected dots 
710. In the case where cards are missing, the general rule is 
that the number of wires coupling the remaining cards is 
doubled. 



8 

Advantageously, the invention provides a novel technique 
for interconnecting cards within a distributed network 
switch while eliminating the conventional switching func- 
tion of the switch by r^rforrning all transfer functions within 

5 the interface circuitry. The distributed switch invention 
further eliminates the single point of failure present in the 
centralized switch. According to the connection technique 
described herein, if a card fails only that card (and its relay 
point) is lost The control information provided to the 
interface circuitry relating to the traffic patterns among the 
network cards allows that circuitry to detect failure of a card. 
Moreover, the geometry of the connection technique defines 
an asymmetric mesh arrangement characterized by a maxi- 
mum 2-hop relay traversal between source and destination 
cards that differs from the conventional cube architecture. 

15 While there has been shown and described an illustrative 
embodiment for maximizing the rate at which data are 
transferred among source and destination network cards of 
a distributed network switch using an efficient connection 
technique, it is to be understood that various other adapta- 

20 tions and modifications may be made within the spirit and 
scope of the invention. For example, although the invention 
utilizes an additional network card of the switch as an 
indirect data path to provide a 2-hop relay between the 
source and destination cards, use of additional relays is 

25 contemplated by the invention. However, in the case of a 
full, uniform mesh, data is transferred over every path in a 
worst-case traffic pattern so there is generally nothing to be 
gained going to. e.g.. a 3 -hop relay arrangement. Although 
the extra connections provided between the cards of a 3 -hop 
arrangement may slightly increase the data transfer 
efficiency, the complexity of scheduling 3-hop relays, i.e.. a 
source card to a relay to another relay and finally to a 
destination card, generally outweighs that advantage. Unlike 
the single-hop, direct connection arrangement where a sig- 

35 nificant number of wires are unused for many traffic 
patterns, the 2-hop arrangement described herein utilizes 
most of the wires. 

The foregoing description has been directed to specific 
embodiments of this invention. It will be apparent, however, 
that other variations and modifications may be made to the 
described embodiments, with the attainment of some or all 
of their advantages. Therefore, it is the object of the 
appended claims to cover all such variations and modifica- 
tions as come within the true spirit and scope of the 

45 invention. 

What is claimed is: 

1. A connection arrangement for maximizing the rate at 
which data are transferred among cards of a distributed 
switch, the arrangement comprising: 

5Q a backplane of the switch; and 

a plurality of cards coupled to the backplane, the cards 
including a source cant a destination card and an 
intermediate card interconnected in a manner such that 
the source card is directly and indirectly connected to 

55 the destination card, the latter indirect connection uti- 
lizing the intermediate card as a relay, 
wherein data is transferred from the source card to the 
destination card over each of the direct and indirect 
connections to maximize the transfer rate efficiency 

60 between the source and destination cards. 

2. The connection arrangement of claim 1 wherein the 
backplane comprises a mesh backplane. 

3. The connection arrangement of claim 1 wherein the 
backplane comprises an asymmetric mesh backplane. 

65 4. The connection arrangement of claim 3 further com- 
prising means for administering the transfer of data over the 
direct and indirect connections. 
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5. The connection arrangement of claim 4 wherein the 
administering means comprises connection interface cir- 
cuitry located on each card, and wherein the connection 
interface circuitry initially establishes the direct connection 
for transferring of data between the source and destination 5 
cards, and further establishes the indirect connection for 
transferring data between the source and destination cards. 

6. The connection arrangement of claim 5 wherein the 
transfer of data over the direct and indirect connections 
occur simultaneously. io 

7. A connection arrangement for maximizing the rate at 
which data are transferred among network cards of a dis- 
tributed network switch, the arrangement comprising: 

a mesh backplane of the network switch; and 
a plurality of network cards coupled to the backplane, the 15 
network cards including a source card, a destination 
card and at least one intermediate card interconnected 
in a manner such that the source network card is 
connected to the destination network card via a direct 
data path and via an indirect data path including the 20 
intermediate card as a relay; and 
means for transferring data from the source card to the 
destination card over an arrangement of the direct and 
indirect data paths to maximize the transfer rate effi- ^ 
ciency between the source and destination cards. 

8. The connection arrangement of claim 7 wherein the 
mesh backplane comprises one of a full and partial mesh 
backplane. 

9. The connection arrangement of claim 8 wherein the ^ 
indirect data path utilizes the intermediate card as a 2-hop 
relay. 

10. The connection arrangement of claim 9 wherein the 
transferring means comprises connection interface circuitry 
located on each card, 35 

11. The connection arrangement of claim 9 wherein the 
connection interface circuitry of each card initially cooper- 
ate to establish the direct data path for transferring data 
between the source and destination cards and, if necessary, 
further cooperate to establish the indirect data path for ^ 
transferring data between the source and destination cards. 

12. The connection arrangement of claim 11 wherein the 
transfer of data over the direct and indirect data paths occur 
simultaneously. 



13. The connection arrangement of claim 12 wherein the 
connection interface circuitry is implemented as an appli- 
cation specific integrated circuit. 

14. A method for maximizing the rate at which data are 
transferred among network cards of a distributed network 
switch, the method comprising the steps of: 

coupling a plurality of network cards to a backplane of the 
network switch, the network cards including a source 
card, a destination card and a plurality of intermediate 
cards; 

configuring the backplane so that the source network card 
is connected to the destination network card via a direct 
data path and via a plurality of indirect data paths, the 
indirect data paths including intermediate cards func- 
tioning as relays between the source and destination 
cards; and 

selecting an indirect datapath having an intermediate card 
utilized as a 2-hop relay; and 

transferring data from the source card to the destination 
card over an arrangement of the direct data path and 
selected indirect data path to maximize the transfer rate 
efficiency between the source and destination cards. 

15. The method of claim 14 wherein the configuring step 
further comprises the steps of: 

establishing the direct data path for transferring data 
between the source and destination cards; and 

contemporaneously establishing the selected indirect data 
path for transferring data between the source and 
destination cards. 

16. The method of claim 15 wherein the step of transfer- 
ring data over the direct and indirect data paths occur 
simultaneously. 

17. The method of claim 15 wherein the step of transfer- 
ring data over the direct and indirect data paths occur 
substantially non- simultaneously. 

18. The method of claim 15 wherein the step of transfer- 
ring data over the direct and indirect data paths occur 
substantially simultaneously. 
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